IN THE UNITED STATES PATENT AND TRADEMARK OFFICE 



|» CERTIFICATE OF EXPRESS MAILING 

Jby certify that this paper and the documents and/or fees referred to as 
geWtherein are being deposited with the United States Postal Service on 
_^£gl5, 1999 in an envelope as "Express Mail Post Orifice to 
^cfSfessee" service under 37 CFR §1.10, Mailing Label Number 
EL2439 13632 US, addressed to the Assistant Cqrnmissioner for Patents, 
Washington, DC 2023 i 



Attorney Docket No.: SUN1P223/P3750 
First Named Inventor: Albers 



Dionna Holmes 




UTILITY PATENT APPLICATION TRANSMITTAL (37 CFR. § 1.53(b)) 



Assistant Commissioner for Patents 
Box Patent Application 
Washington, DC 20231 



| | Duplicate for 
fee processing 




Sir: This is a request for filing a patent application under 37 CFR. § 1 .53(b) in the name of inventors: 

Michael C. Albers and John T. Clingan 

For: CROSS-PLATFORM AUDIO FEEDBACK FOR GUI COMPONENTS 

A pplication Elements: 



^ 33 Pages of Specification, Claims and Abstract 

09 Sheets of formal Drawings 
^ 02 Pages Combined Declaration and Power of Attorney - executed 



Accompanying Application Parts : 



□ 



Assignment and Assignment Recordation Cover Sheet (recording fee of $40.00 enclosed) 
| | 37 CFR 3.73(b) Statement by Assignee 

Information Disclosure Statement with Form PTO-1449 
| | Copies of IDS Citations 
| | Preliminary Amendment 
E>\| Return Receipt Postcard 
| | Small Entity Statements) 
| | Other: 



Fee Calculation (37 CFR § 1.16) 

(Col. 1) 
NO. FILED 



BASIC FEE 
TOTAL CLAIMS 
INDEP CLAIMS 



24 -20 
6 -03 



(Col. 2) 

NO. 

EXTRA 



= 4 

= 3 



SMALL ENTITY 
RATE FEE 



OR LARGE ENTITY 
RATE FEE 



[ ] Multiple Dependent Claim Presented 

* If the difference in Col. 1 is less 
than zero, enter "0" in Col. 2. 



$380 

x9 

x39 

$130 

Total 



$ 

= $ 
= $ 
$ 
$ 



$760 
x 18 
x78 
$260 
OR Total 



OR 
OR 
OR 



$760 
= $72 
= $234 

$ 

$1066 



(Revised 4/99, Pat App Trans 53(b) Reg 



Page 1 of 2 



Check No. 2153 in the amount of $ 1J06 is enclosed. 



^ The Commissioner is authorized to charge any fees beyond the amount enclosed which may be 
required, or to credit any overpayment, to Deposit Account No. 50-0388 (Order No SUN1P223). 



General Authorization for Petition for Extension of Time (37 CFR §1.136) 

Applicants hereby make and generally authorize any Petitions for Extensions of Time as may be 
needed for any subsequent filings. The Commissioner is also authorized to charge any extension fees under 
37 CFR §1.17 as may be needed to Deposit Account No. 50-0388. 



^X] Please send correspondence to the following address: 

022434 



Customer Number: 022434 

BEYER & WEAVER, LLP ?m W mmm office 

P.O. Box 61059 
Palo Alto, CA 94306 



Date: October 15, 1999 Q^y^ rf\ 

Josetm M. Villeneuve 



Joseph M. Villeneuve 

Registration No. 37,460 



(Revised 4/99, Pat App Trans 53(b) Reg 



Page 2 of 2 



Attorney Docket No. SUN1P223/P3750 



PATENT APPLICATION 

Cross-Platform Audio Feedback for GUI 
Components 



By Inventor: Michael C. Albers 

1366-A 12th Avenue 
San Francisco, CA 94122 
A United States Citizen 

John T. Clingan 
1608 Woodridge Circle 
Foundation Valley, CA 92708 
A United States Citizen 



Assignee: Sun Microsystems, Inc. 

901 San Antonio Road 
Palo Alto, CA 94303 



Entity: Large 



BEYER & WEAVER, LLP 
P.O. Box 61059 
Palo Alto, CA 94306 
Telephone (510) 493-2100 



Cross-Platform Audio Feedback for GUI 
Components 

Field of the Invention 

The present invention relates to the field of computing, and more 
particularly, to software, methods and systems which allow audio 
functionality for various graphical user interface (GUI) look and feel 
components in Java. 

Background of the Invention 

In recent years significant efforts have been made to facilitate the 
creation of platform independent software. That is, software that can execute 
on multiple platforms (e.g. different types of computer or operating systems), 
without requiring the software program to be rewritten or customized to 
operate on specific platforms. By way of example, the Java programming 
language is designed to facilitate the creation of Java software objects that are 
platform independent. However, in certain situations, it is desirable for a 
particular software object to make use of platform dependent code to provide 
a particular functionality. One such platform dependent functionality used by 
software objects is an audio function. 

An audio function represents software used to enable the 
communication of sound between a computer system and a user. For 
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example, in a graphical user interface environment (GUI), a sound may be 
used to communicate an event such as opening, dragging or closing a window. 

There has been a great deal of work on various Java technologies to 
ensure seamless integration with the underlying platform, architecture or 
operation system (OS). If a program is truly seamlessly integrated, a person 
that is executing a Java program on a particular platform should not be able to 
distinguish a Java program from a native one. Stated slightly differently, the 
user's experience should be the same whether the application is created using 
Java code or native code. The most significant aspect of the user's experience 
is typically the GUI "look and feel". More specifically, for a particular GUI 
event, the user expects the same response from the Java program as a native 
one. 

The JAVA Foundation classes (JFC's), including the Swing 
component set, is one way to ensure seamless integration with the underlying 
platform. Swing provides many standard GUI components such as buttons, 
lists, menus, and text areas, and also includes event-handling methods of how 
a program responds to external events. Having separate data and state models 
makes the Swing components highly customizable, and enables sharing data 
between components. Further, Swing offers many features including support 
for icons, actions, Pluggable Look & Feel (PLAF) technology, assistive 
technologies, and separate models. Swing's Pluggable Look & Feel 
architecture gives the user a wide choice of look-and-feel options. In addition 
to the usual platform-specific looks and feels, the user can also use the Java 
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Look & Feel, add an accessory look and feel, or use a third-party look and 
feel. 

FIG. 1 illustrates a conventional software configuration 100 of objects 
concerned with look and feel (L&F) issues inside a running Swing 
application. The conventional software configuration 1 00 includes a 
component 102, a UI Manager 104, and a primary L&F 106. These three 
objects communicate to arrive at an appearance and behavior for the 
component 102. The component 102 may be any widget whose actions may 
utilize or lead to an event, i.e. a button which closes a window producing a 
particular sound. 

The UI Manager 104 is a resource that allows communication between 
all the different parts of the conventional software configuration 100. The 
L&F being used is generally considered the primary L&F 106. This primary 
L&F 106 is either the L&F which emulates the underlying L&F or it is the 
cross-platform Java L&F (JLF). By way of example, a JLF representation of 
a Metal L&F is the primary L&F 106 for the conventional software 
configuration 100. The current L&F is the one implemented by the UI 
Manager 104. Conventionally, the current L&F is the same as the primary 
L&F. 

To facilitate the applicability of Swing, each emulated look and feel, 
such as the Windows L&F and the Motif L&F, must appear and behave like 
the native platform. A growing number of important Java platforms rely on 
audio cues to inform users of interaction and system activities. Unfortunately, 
there is no mechanism for providing platform dependent audio functionality in 
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the JFC. By way of example, conventional audio events within a L&F are not 
applicable to Swing. 

In view of the foregoing, it should be apparent that a mechanism 
which allows audio functionality on platform dependent software the JFC 
5 would be desirable. 

Summary of the Invention 

The invention relates, in accordance with one embodiment to an audio 
10 computer service. The service includes a system manager. The system also 
includes a component capable of an audio event designed to run on a first 
platform serviced by the audio computer service. The system further includes 
a software object having a set of entries wherein one entry is associated with 
the audio event and a theme including a first set of platform dependent audio 
15 fields, each platform dependent audio field associated with at least one audio 
event of the set of audio events, wherein the theme is arranged to permit the 
emulation the audio events of the first platform. 

In another embodiment, the invention relates to a computer- 
implemented method of accessing, by a computer service, a platform 
20 dependent audio field associated with an audio event on a first platform. The 
method includes receiving a request for a platform dependent audio file. The 
method also includes importing a theme corresponding to the platform 
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dependent audio file including at least one platform dependent audio field 
associated with the audio event. The method further includes referencing the 
platform dependent audio field corresponding to the audio event from the 
theme. The method may also include providing audio output associated with 
the platform dependent audio field. 

In yet another embodiment, the invention relates to a software object 
for servicing audio events for a computer service. The object including of a 
first set of platform dependent fields capable of facilitating audio output a first 
platform. The object also including a set of audio events, wherein each audio 
event is associated with at least one platform dependent field of the first set of 
platform dependent fields. In addition, the first set of platform dependent 
fields are included in a first theme which relates the first set of platform 
dependent fields for the first platform to the set of audio events. 



Brief Description of the Drawings 

The invention will be better understood by reference to the following 
description taken in conjunction with the accompanying drawings in which: 

FIG. 1 illustrates a conventional software configuration 100 of objects 
concerned with L&F issues inside a running Swing application. 

FIG. 2 illustrates an audio L&F software configuration 200 inside a 
nmning Swing application in accordance with one embodiment of the present 
invention. 
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FIG 3 A and 3B illustrate exemplary hash tables applicable with the 
present invention. 

FIG. 4 is a flowchart detailing a process for installing the Audio L&F 
in accordance with an embodiment of the invention. 

FIG. 5 illustrates a process of initializing the Audio L&F in 
accordance with one embodiment of the present invention. 

FIG. 6 is a flowchart detailing a process in which an audio event is 
processed. 

FIG. 7 is a flowchart illustrating a theme change in accordance with 
one embodiment of the present invention. 

FIG. 8 is a block diagram of a typical computer system suitable for 
implementing an embodiment of the present invention. 

FIG. 9a is a block/process diagram illustrating the transformation of a 
Java™ program containing Java source code to native code to be run on a 
particular platform or computer. 

FIG. 9b is a diagrammatic representation of virtual machine, supported 
by the computer system of FIG. 8 described below. 
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Detailed Description of the Drawings 



The present invention will now be described in detail with reference to 
the preferred embodiments thereof as illustrated in the accompanying 
drawings. In the following description, numerous specific details are set forth 
5 in order to provide a thorough understanding of the present invention. It will 
be apparent, however, to one skilled in the art, that the present invention may 
be practiced without some or all of these specific details. In other instances, 
well known process steps and/or structures have not been described in detail 
in order to not unnecessarily obscure the present invention. 

10 A Pluggable L&F (PLAF) apparatus and method is described which 

emulates the audio functionality of multiple platforms. The platform may be a 
L&F, operating system (OS) or any other GUI environment. A single audio 
PLAF with multiple L&F audio functionality is referred to as an Audio L&F 
(ALF). The Audio L&F includes a set of themes wherein each theme 

15 corresponds to the audio functionality for a particular platform. The theme 
includes a number of entries wherein each entry provides a mapping between 
an audio event for a GUI component and the respective audio output. 

The Audio L&F apparatus and method may be implemented in Java. 
In one embodiment, audio functionality may be implemented by utilizing the 

20 conventional PLAF architecture of the Swing components. In another 

embodiment, the Audio L&F defines and implements additional infrastructure 
to Java components to permit audio functionality. For example, a Multiplexer 
may be used to present a single audio L&F as well as track and facilitate 
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primary L&F changes. In another embodiment of the present invention, the 
Audio L&F allows the creation of advanced audio user interfaces in Swing to 
facilitate new applications on the Java platform. 

The present invention provides reinforcement of GUI activity through 
5 audio cues. Advantageously, a cross-modality communication of information 
may be provided to decrease the users' visual load. Further, the present 
invention permits a flexible alternate presentation of pertinent information as 
well as utilization of real-world sounds which leverages the users' knowledge 
of their environment. 

1 o Additionally, the present invention allows integration of Swing 

applications into their existing native environments to increase the perceived 
quality of Java applications. Providing the audio cues that the user expects 
form their native environment may more fully integrate Java applications into 
a user's interaction experience. In addition, adding audio feedback to an 

15 interface may increase the perceived quality of the application itself. 

FIG. 2 illustrates an audio L&F software configuration 200 inside a 
running Swing application in accordance with one embodiment of the present 
invention. The Swing toolkit is included in the Java Foundations Classes 
(JFC). The software configuration 200 includes a component 202, a UI 

20 Manager 204, a Multiplexer 206, a primary L&F 208 and an Audio L&F 2 1 0. 
These objects communicate to provide audio behavior for the component 202. 

The component 202 may be any widget or GUI object whose actions 
may utilize or lead to an audio event. For example, the component 202 may 
be a button, scroll bar, frame, etc. The audio event may be any action by the 
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component 202 which leads to an audio output or function between the 
computer and the user. By way of example, the event may be the movement 
of a slider, dragging a GUI object or any other user interface action performed 
by the component 202. The component 202 may also be capable of multiple 
events. By way of example, a mouse button may have over forty audio events 
within a particular L&F. 

A L&F will generally define the user interface for any known 
component 202 within the L&F. As a result, there will generally be a portion 
of code responsible for the component 202. The code will determine the look 
of the component 202 as well as actions and events performed by the 
component 202. Attached to this code, a listener 212 may be added for 
facilitating communication within the audio L&F software configuration 200. 
The listener 212 may be considered a sensor to an event or action for the 
component 202. 

Since the component 202 typically only interacts with a single L&F, 
the Multiplexer 206 may be used to manage requests and events for multiple 
and simultaneous L&Fs. To handle the multiple L&Fs, the Multiplexer 206 
acts an interface between the component 202 and the current L&F to allow 
communication therebetween. 

Conventionally, the primary L&F 208 is the same as the current L&F. 
With the addition of the Multiplexer 206, the primary L&F 208 may be 
differentiated from an auxiliary L&F, such as the Audio L&F 210. In this 
manner, one primary L&F 208 is still maintained, however, there may be a 
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number of auxiliary L&Fs wherein the current L&F is the L&F represented by 
the Multiplexer 206. 

The UI Manager 204 is a resource that allows communication between 
the different entities in the audio L&F software configuration 200. By way of 
5 example, an application which requires information about or a change in the 
primary L&F 208 does so through the UIManager 204. 

To emulate the audio output for multiple L&Fs, the Audio L&F 210 
includes a theme 214 for each L&F it is responsible for. The theme 214 may 
be considered a set of audio cues that map onto the audio events in the user 
10 interface. Alternately, the theme 214 may be a set of fields, common to a 
particular L&F, each of which associates with at least one event for the 
component 202, Within a field there may be a pointer or suitable structure 
responsible for facilitating the audio output for the associated event. The 
theme structure within the Audio L&F 210 allows the cues for the audio 
15 events to be replaced for a L&F without replacing the L&F itself. 

For the audio L&F software configuration 200, the Audio L&F 210 
typically corresponds to the primary L&F 208 currently installed and running 
on the user interface. When the primary L&F 208 is changed, the Audio L&F 
210 loads the appropriate theme for the new L&F. In one embodiment, the 
20 Audio L&F 2 1 0, by attending a listener to the UI Manager 204, is notified 
when the Multiplexer 206 changes the primary L&F 208. 
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There may be multiple audio mechanisms within the audio L&F 
software configuration 200. When the UIManager 204 is requested to plug in 
the Audio L&F 210 as an auxiliary L&F, the Audio L&F 210 may become the 
primary audio mechanism among the multiple audio output mechanisms. 
Thus, in accordance with the pluggable L&F nature of the invention, the 
Audio L&F 210 may be turned on/off as required and may be present in the 
computer system without being continuously active. In another embodiment, 
the Audio L&F 210 may be implemented as a L&F which is not plugged in 
and out unless there is no audio output for the computer system. 

The platform independent audio functionality of the present invention 
can be achieved by emulating any pluggable or auxiliary L&F. For example, 
five commonly used PLAFs include the Motif L&F, Macintosh L&F, 
Windows L&F, Java L&F and the Multiplexer 206. The Macintosh L&F, 
Motif L&F, and Windows L&F all extend the Basic L&F to take advantage of 
Basic's built-in event handling and generic painting code. In a preferred 
embodiment of the present invention, the Audio L&F 210 does not extend 
Basic. In this case, the Audio L&F 210 will extend the PLAF directly to 
allow special event handling and zero painting. To facilitate emulation of the 
audio functionality of each of the L&Fs, each pluggable or auxiliary L&F may 
be notified when the Multiplexer 206 changes the primary L&F 208 or when a 
new theme is swapped. 

The Audio L&F 210 and supporting theme structure may be 
implemented in any suitable software manner. FIG 3 A illustrates an 
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exemplary hash table 300 used to correlate audio events with audio output in 
accordance with the present invention. The hash table 300 contains a set of 
entries in which an entry includes an event 302 corresponding to a field 304. 
For example, the entry 306 includes an event of pressing a mouse button 308 
within a Macintosh L&F. 

The field 304 may include a pointer or code which may lead to any 
suitable file or information capable of providing audio output from the 
computer system. The file may be an audio file, mini-file, algorithm, etc. 
Alternately, the pointer may lead to a Java object, a Java speech synthesis 
engine file, or part thereof. By way of example, for the event of pressing the 
left mouse button over a button 308, the field 312 includes a pointer which 
leads to a file designated as " /audio/mac/button.mouse.press.aif \ 

Typically, the UI Manager 204 may keep track of the hash table 300, 
the themes installed, many of the generic names for the components and other 
protocols relevant to the software configuration 200. The structure of the hash 
table 300 and entries may be any such structure for suitably carrying out the 
proposed invention. In the Swing embodiment, the hash table 300 is a UI 
defaults table. For a more detailed description of Java applications, the reader 
is referred to "Graphic Java 2, Volume II: Swing" ISBN 0-13-079667-0. 

The location of the hash table 300 may vary. For example, the hash 
table 300, or any part thereof, may be stored locally to prevent 
computationally expensive returns to a non-local hash table. Alternately, the 
hash table 300 may be located in non-volatile memory. In one embodiment, 
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when a UI is installed, the hash table 300 is built and the fields are updated 
locally. In this manner, a local cache is stored of the default table values, 
facilitating the processing of the audio information. In one Swing 
embodiment, the audio files used by the Audio L&F 210 may be instantiated 
to enhance the load time for activating the Audio L&F 210. 

It should be noted that new or alternative forms of audio events not 
existing in a current L&F may be added to the hash table 300. In this case, a 
new entry may be added for the new event as well as a corresponding new 
field. In addition, listeners may be added to the respective component 
responsible for the new event. In this manner, audio features of new versions 
of a L&F may be easily adapted to the present invention. 

FIG 3B illustrates an alternate hash table 330 for use with the present 
invention. The alternate hash table 330 includes all the events of the hash 
table 300 but has been replaced by fields for a Window L&F theme. In this 
case, is important to note that some of the entries in the hash table 330 include 
null fields 332 and 334. Generally, if a field is not null, an audio output will 
be taken for the action. 

The events that may lead to an audio output may vary drastically from 
platform to platform. Typically, to translate between Java and a particular 
L&F, the relevant audio events are determined as well as the corresponding 
output. From this point, the theme and hash table may be built from the 
relevant audio events within the particular L&F. Thus, within the Audio L&F 
210, the event 308 may then be associated with multiple themes. In this 
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manner, the event 308 is capable of running on as many platforms as 
supported by the available themes. By way of example, the event 308 may 
associate with a library of fields individually corresponding to a particular 
operating system including Windows NT, Win32, UNIX, etc. 
5 Since the Audio L&F 210 is a general mechanism for L&F specific 

audio generation, the opportunity may arise to provide audio cues for a large 
number of different types of UI events. As an aid to solving the problem of 
providing audio cues in a coherent manner, it may be helpful to decompose 
the possible audio events in an organized manner within the hash table 300. 

10 For example, it may be useful to separate audio events into categories 

belonging to an interaction taxonomy. These categories will also help during 
the creation of audio cues by providing a guide as to which sounds should be 
similar to the others within the same category or sub-category. 

In a preferred embodiment, two main categories of audio events are 

15 implemented: user actions and system activities. User actions are best 
described as anything that the user does that causes a change in the user 
interface. System activities are processes that are initiated by the machine(s) 
with which the user is interacting with. This machine may be the machine in 
front of the user or a machine physically distant on a network, for example. 

20 Alternately, system activities may be the user actions of another user. In other 
words, system activities are audio events that are not user actions. 

A process of implementing the Audio L&F 210 within the audio L&F 
software configuration 200 will now be described with respect to FIGs. 4-7. 
FIG. 4 is a flowchart detailing a process 400 for installing the Audio L&F 210 
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onto a L&F in accordance with an embodiment of the invention. It should be 
noted that the process 400 is applicable to any platform dependent software. 

The process 400 begins with a request for the UI Manager 204 to 
install the Audio L&F 210 as the auxiliary L&F (402). Typically, the system 
is established and the UI Manager 204 is aware of a primary L&F already 
installed (FIG. 1 A). As there is more than one L&F available, the UI 
Manager 204 adds the Multiplexer 206. In addition, the UI Manager 204 sets 
the Multiplexer 206 as the current L&F (404). At this point, the current L&F 
and the primary L&F are not the same. Thus, the UI Manager 204 informs the 
Multiplexer 206 that the old current L&F is now the primary L&F (406). In 
addition, the UI Manager 204 also informs the Multiplexer 206 that the Audio 
L&F 210 is an auxiliary L&F (408). Finally, the Multiplexer 206 instructs 
the Audio L&F 210 to initialize (410) according to process 500. 

FIG. 5 illustrates a process 500 of initializing the Audio L&F 210 in 
accordance with one embodiment of the present invention. The process 
begins with establishing a connection between the Audio L&F 210 and the 
components in a platform whose actions may lead to audio output. To 
accomplish this, Audio L&F 210 may add a series of listeners (502) to the 
pertinent components of the computer system. In this manner, upon an event 
for the component 202, or when values within the component 202 change, the 
UI Manager 204 is signaled of the event At this point, the process 500 
determines the primary L&F (504) and loads the appropriate theme (506) for 
the primary L&F. The process 500 then caches the hash table 300 values 
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from the appropriate theme in the UI member variable (508). The UI member 
variable refers to the memory space for the current theme which stores the 
information of the audio output which is to be played. 

FIG. 6 is a flowchart detailing a process 600 in which the UI Manager 
5 204 processes an audio request. The process 600 begins by the component 
202 signaling an event leading to notification of the UI Manager 204 using the 
listeners (602). Once the event has been received, a check may be made to the 
state of the component 202. This check determines which particular action of 
the possible actions for the component requires the audio output. For 

10 example, if the mouse button is pressed, the action may be opening or closing 
a window and thus a check is made to determine whether the window is 
currently open or closed. Correspondingly, based on the component 202 and 
its respective state, the appropriate audio pointer associated with the action is 
retrieved from the hash table 300 (604). If the pointer is null (606), no sound 

15 will be played. Otherwise, the appropriate audio information corresponding to 
the pointer is processed (608). 

The present invention allows L&Fs to be switched on the fly. For 
example, if a user desires to switch from a Macintosh L&F to a Motif L&F, 
this may be accomplished while the application is running. FIG. 7 is a 
20 flowchart illustrating a theme change 700 in accordance with one embodiment 
of the present invention which permits audio platform changes on the fly. The 
process 700 generally begins when the UI Manager 204 notifies the Audio 
L&F 210 of a primary L&F change (702). Typically, the UI Manager 204 has 
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already notified the Multiplexer 206 that an auxiliary L&F is required in 
which the Audio L&F 210 is currently operating. At this point, the process 
determines the new primary L&F (704) and loads the appropriate theme for 
the new primary L&F (706). The process 700 then renews the caches of the 
hash table fields for the new theme (708). 

In one embodiment of the present invention, existing technology is 
used apart from the Audio L&F 210 infrastructure and Multiplexer 206. The 
existing technology may include a PLAF mechanism, its default table 
infrastructure, corresponding themes mechanism, the existing event 
mechanism, the accessibility infrastructure, and the existing audio support in 
Java2. 

Alternately, the present invention may require new functionality. For 
example, multiple classes may be created and implemented as layers on top of 
the existing audio infrastructure to further abstract the audio functionality 
within the Audio L&F 210. In a specific embodiment, the Audio L&F 210 UI 
classes were created for a large number of Swing components. By way of 
example, the Audio L&F 210 UI classes were added for the following 
components: Jbutton, JcheckBox, JtoggleButton, JmenuBar, Jmenultem, 
JcheckBoxMenuItem, JradioButtonMenuItem, Jtree, Jtable, JInternalFrame 
and JoptionalPane. 

The present invention may employ various computer-implemented 
operations involving information stored in computer systems. These 
operations include, but are not limited to, those requiring processing of audio 
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files and output. Usually, though not necessarily, these files take the form of 
electrical or magnetic signals capable of being stored, transferred, combined, 
and otherwise manipulated. It is sometimes convenient, principally for 
reasons of common usage, to refer to these electrical or magnetic signals as 
5 bits, values, elements, variables, characters, or the like. It should 

remembered, however, that all of these and similar terms are to be associated 
with the appropriate audio output and are merely convenient labels applied to 
these output. 

The present invention also relates to a device, system or apparatus for 
10 performing the aforementioned operations. The system may be specially 
constructed for the required purposes, or it may be a general purpose 
computer selectively activated or configured by a computer program stored in 
the computer. The processes presented above are not inherently related to any 
particular computer or other computing apparatus. In particular, various 
15 general purpose computers may be used with programs written in accordance 
with the teachings herein, or, alternatively, it may be more convenient to 
construct a more specialized computer system to perform the required 
operations. 

FIG. 8 is a block diagram of a general purpose computer system 800 
20 suitable for carrying out the processing in accordance with one embodiment of 
the present invention. For example, JVM 907, virtual machine 91 1, or 
bytecode compiler 903 can run on general purpose computer system 800. 
FIG. 8 illustrates one embodiment of a general purpose computer system. 
Other computer system architectures and configurations can be used for 
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carrying out the processing of the present invention. Computer system 800, 
made up of various subsystems described below, includes at least one 
microprocessor subsystem (also referred to as a central processing unit, or 
CPU) 802. That is, CPU 802 can be implemented by a single-chip processor 
5 or by multiple processors. CPU 802 is a general purpose digital processor 
which controls the operation of the computer system 800. Using instructions 
retrieved from memory, the CPU 802 controls the reception and manipulation 
of input information, and the output and display of information on output 
devices. 

10 CPU 802 is coupled bi-directionally with a first primary storage 804, 

typically a random access memory (RAM), and uni-directionally with a 
second primary storage area 806, typically a read-only memory (ROM), via a 
memory bus 808. As is well known in the art, primary storage 804 can be 
used as a general storage area and as scratch-pad memory, and can also be 

15 used to store input data and processed data. It can also store programming 
instructions and data, in addition to other data and instructions for processes 
operating on CPU 802, and is typically used for fast transfer of data and 
instructions bi-directionally over memory bus 808. Also, as is well known in 
the art, primary storage 806 typically includes basic operating instructions, 

20 program code, data and objects used by the CPU 802 to perform its functions. 
Primary storage devices 804 and 806 may include any suitable computer- 
readable storage media, described below, depending on whether, for example, 
data access needs to be bi-directional or uni-directional. CPU 802 can also 
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directly and very rapidly retrieve and store frequently needed data in a cache 
memory 810. 

A removable mass storage device 812 provides additional data storage 
capacity for the computer system 800, and is coupled either bi-directionally or 
uni-directionally to CPU 802 via a peripheral bus 814. For example, a 
specific removable mass storage device commonly known as a CD-ROM 
typically passes data uni-directionally to the CPU 802, whereas a floppy disk 
can pass data bi-directionally to the CPU 802. Storage 812 may also include 
computer-readable media such as magnetic tape, flash memory, signals 
embodied in a carrier wave, Smart Cards, portable mass storage devices, and 
other storage devices. A fixed mass storage 816 also provides additional data 
storage capacity and is coupled bi-directionally to CPU 802 via peripheral bus 
814. Generally, access to these media is slower than access to primary 
storages 804 and 806. Mass storage 812 and 816 generally store additional 
programming instructions, data, and the like that typically are not in active use 
by the CPU 802. It will be appreciated that the information retained within 
mass storage 812 and 816 may be incorporated, if needed, in standard fashion 
as part of primary storage 804 {e.g. RAM) as virtual memory. 

In addition to providing CPU 802 access to storage subsystems, the 
peripheral bus 814 is used to provide access to other subsystems and devices 
as well. In the described embodiment, these include a display monitor 818 
and adapter 820, a printer device 822, a network interface 824, an auxiliary 
input/output device interface 826, a sound card 828 and speakers 830, and 
other subsystems as needed. 
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The network interface 824 allows CPIJ 802 to be coupled to another 
computer, computer network, or telecommunications network using a network 
connection as referred to. Through the network interface 824, it is 
contemplated that the CPU 802 might receive information, e.g., objects, 
5 program instructions, or bytecode instructions from a computer in another 
network, or might output information to a computer in another network in the 
course of performing the above-described method steps. Information, often 
represented as a sequence of instructions to be executed on a CPU, may be 
received from and outputted to another network, for example, in the form of a 

10 computer data signal embodied in a carrier wave. An interface card or similar 
device and appropriate software implemented by CPU 802 can be used to 
connect the computer system 800 to an external network and transfer data 
according to standard protocols. That is, method embodiments of the present 
invention may execute solely upon CPU 802, or may be performed across a 

15 network such as the Internet, intranet networks, or local area networks, in 
conjunction with a remote CPU that shares a portion of the processing. 
Additional mass storage devices (not shown) may also be connected to CPU 
802 through network interface 824. 

Auxiliary I/O device interface 826 represents general and customized 

20 interfaces that allow the CPU 802 to send and, more typically, receive data 

from other devices. Also coupled to the CPU 802 is a keyboard controller 832 
via a local bus 834 for receiving input from a keyboard 836 or a pointer 
device 838, and sending decoded symbols from the keyboard 836 or pointer 
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device 838 to the CPU 802. The pointer device may be a mouse, stylus, track 
ball, or tablet, and is useful for interacting with a graphical user interface. 

In addition, embodiments of the present invention further relate to 
computer storage products with a computer readable medium that contain 
program code for performing various computer-implemented operations. The 
computer-readable medium is any data storage device that can store data 
which can thereafter be read by a computer system. Examples of computer- 
readable media include, but are not limited to, all the media mentioned above, 
including hard disks, floppy disks, and specially configured hardware devices 
such as application-specific integrated circuits (ASICs) or programmable logic 
devices (PLDs). The computer-readable medium can also be distributed as a 
data signal embodied in a carrier wave over a network of coupled computer 
systems so that the computer-readable code is stored and executed in a 
distributed fashion. 

It will be appreciated by those skilled in the art that the above 
described hardware and software elements are of standard design and 
construction. Other computer systems suitable for use with the invention may 
include additional or fewer subsystems. In addition, memory bus 808, 
peripheral bus 814, and local bus 834 are illustrative of any interconnection 
scheme serving to link the subsystems. For example, a local bus could be 
used to connect the CPU to fixed mass storage 816 and display adapter 820. 
The computer system referred to in FIG. 8 is but an example of a computer 
system suitable for use with the invention. Other computer architectures 
having different configurations of subsystems may also be utilized. 
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FIG. 9a is a block diagram showing the inputs/outputs and the 
executing software/systems involved in creating native instructions from Java 
source code in accordance with one embodiment of the present invention. In 
other embodiments, the present invention can be implemented with a virtual 
machine for another language or with class files other than Java class files. 
Beginning with the left side of the diagram, the first input is Java source code 
901 written in the Java™ programming language developed by Sun 
Microsystems of Mountain View, California. Java source code 901 is input to 
a bytecode compiler 903. Bytecode compiler 903 is essentially a program that 
compiles source code 901 into bytecodes. Bytecodes are contained in one or 
more Java class files 905. Java class file 905 is portable in that it can execute 
on any computer that has a Java virtual machine (JVM). Components of a 
virtual machine are shown in greater detail in FIG. 9B. Java class file 905 is 
input to a JVM 907. JVM 907 can be on any computer and thus need not be 
on the same computer that has bytecode compiler 903. JVM 907 can operate 
in one of several roles, such as an interpreter or a compiler. If it operates as a 
compiler, it can further operate as a "just in time" (JIT) compiler or as an 
adaptive compiler. When acting as an interpreter, the JVM 907 interprets 
each bytecode instruction contained in Java class file 905. 

FIG. 9b is a diagrammatic representation of virtual machine 911, such 
as JVM 907, that can be supported by computer system 800 of FIG. 8. As 
mentioned above, when a computer program, e.g., a program written in the 
Java™ programming language, is translated from source to bytecodes, source 
code 901 is provided to a bytecode compiler 903 within a compile-time 
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environment 903. Bytecode compiler 909 translates source code 901 into 
bytecodes 905. In general, source code 901 is translated into bytecodes 905 at 
the time source code 901 is created by a software developer. 

Bytecodes 905 can generally be reproduced, downloaded, or otherwise 

5 distributed through a network, e.g., through network interface 824 of FIG. 8, 
or stored on a storage device such as primary storage 804 of FIG. 8. In the 
described embodiment, bytecodes 903 are platform independent. That is, 
bytecodes 903 may be executed on substantially any computer system that is 
running a suitable virtual machine 911. Native instructions formed by 

10 compiling bytecodes may be retained for later use by the JVM. In this way 
the cost of the translation are amortized over multiple executions to provide a 
speed advantage for native code over interpreted code. By way of example, in 
a Java™ environment, bytecodes 905 can be executed on a computer system 
that is running a JVM. 

1 5 Bytecodes 905 are provided to a runtime environment 9 1 3 which 

includes virtual machine 911. Runtime environment 913 can generally be 
executed using a processor such as CPU 802 of FIG. 8. Virtual machine 91 1 
includes a compiler 915, an interpreter 917, and a runtime system 919. 
Bytecodes 905 can generally be provided either to compiler 915 or interpreter 

20 917. 

When bytecodes 905 are provided to compiler 915, methods contained 
in bytecodes 905 are compiled into native machine instructions (not shown). 
On the other hand, when bytecodes 905 are provided to interpreter 317, 
bytecodes 305 are read into interpreter 917 one bytecode at a time. Interpreter 
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917 then performs the operation defined by each bytecode as each bytecode is 
read into interpreter 917. In general, interpreter 917 processes bytecodes 905 
and performs operations associated with bytecodes 905 substantially 
continuously. 

When a method is called from an operating system 92 1 , if it is 
determined that the method is to be invoked as an interpreted method, runtime 
system 919 can obtain the method from interpreter 917. If, on the other hand, 
it is determined that the method is to be invoked as a compiled method, 
runtime system 919 activates compiler 915. Compiler 915 then generates 
native machine instructions from bytecodes 905, and executes the machine- 
language instructions. In general, the machine-language instructions are 
discarded when virtual machine 91 1 terminates. The operation of virtual 
machines or, more particularly, Java™ virtual machines, is described in more 
detail in The Java™ Virtual Machine Specification by Tim Lindholm and 
Frank Yellin (ISBN 0-201-63452-X), which is incorporated herein by 
reference in its entirety. 

Although the foregoing invention has been described in some detail for 
purposes of clarity of understanding, it will be apparent that certain changes 
and modifications may be practiced within the scope of the appended claims. 
For example, although the invention has been discussed with respect to the 
mentioned L&Fs, other L&Fs may be suitably implemented without escaping 
the nature of the present invention. In addition, the platform independent 
audio apparatus may be any such service and is not restricted to Java. 
Alternately, a broad range of potential interaction taxonomies for classifying 
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events are obviously applicable and thus the present invention is not limited to 
any single taxonomy or hierarchy. For example, the audio events may be 
named and organized according to component and event. Moreover, it should 
be noted that although the present invention has been illustrated with respect 
5 to output-only, non-speech user interface, the present invention is also 
applicable to support output speech audio types as well as user input 
interfaces. Accordingly, the present embodiments are to be considered as 
illustrative and not restrictive, and the invention is not to be limited to the 
details given herein, but may be modified within the scope and equivalents of 
10 the appended claims. 
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In the claims: 



An audio computer service comprising: 



a system manager; 



5 



a component capable of an audio event designed to run on a first 



platform serviced by the audio computer service; and 

a software object having a set of entries, wherein at least one entry is 
associated with the audio event and a first theme, the first theme including a 
first set of platform dependent audio fields, each platform dependent audio 
10 field associated with at least one audio event, wherein the first theme is 
arranged to permit the emulation the audio events of the first platform. 



2. 



The audio computer service of claim 1 wherein the audio 



computer service is Java. 



15 



3. 



The audio computer service of claim 1 wherein the audio event 



is a GUI audio event. 



4. 



The audio computer service of claim 1 wherein the first 



20 platform is an operating system. 
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5. The audio computer service of claim 4 wherein the operating 
system is one of a Windows operating system, a Motif operating system or a 
Macintosh operating system. 

6. The audio computer service of claim 1 wherein the software 
object is stored in volatile memory. 

7. The audio computer service of claim 1 further including a 
second platform serviced by the computer service. 

8. The audio computer service of claim 7 further including a 
second theme including a second set of platform dependent audio fields. 

9. The audio computer service of claim 7 wherein the first and 
second theme are arranged to permit the emulation of audio events of different 
graphical user interfaces. 

10. The audio computer service of claim 1 further including a 
Multiplexer. 

1 L The audio computer service of claim 1 wherein one platform 
dependent audio field in the first set of platform dependent audio fields 
includes a pointer. 
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12. A computer-implemented method of accessing, by an audio 
computer service, a platform dependent audio field associated with an audio 
event from a first platform, the method comprising: 

receiving a request for a platform dependent audio function; 

importing a theme corresponding to the platform dependent audio 
function including at least one platform dependent audio field associated with 
the platform dependent audio function; and 

referencing the platform dependent audio field corresponding to the 
platform dependent audio function. 

1 3 . The method of 12 further including accessing a platform 
dependent audio file corresponding to the platform dependent audio field, 

14. The method of 12 wherein calling the theme corresponding to 
the platform dependent audio field uses a Multiplexer. 

1 5. The method of 12 further including adding a listener to a 
component which provides the audio event. 

16. A software object for servicing audio events, the object 
comprising: 
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a first set of platform dependent fields which can provide audio output 
for a first platform; and 

a set of audio events, each audio event associated with at least one 
platform dependent field of the first set of platform dependent fields, wherein 
5 the first set of platform dependent fields are included in a first theme which 
relates the first set of platform dependent fields to a first platform. 



17. The software object of claim 16 further including a second 
theme which includes a second set of platform dependent fields for a second 
10 platform 



18. The software object of claim 16 wherein the first platform is 
one of a Windows look and feel, a Motif look and feel or a Macintosh look 
and feel. 

19. The software object of claim 16 wherein the software object is 
a hash file. 



20. The software object of claim 1 6 wherein the set of audio 
20 events is organized into categories. 
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21. The software object of claim 16 wherein the software object is 
a hash file. 

22. An audio computer service comprising: 
5 a system manager; 

a component capable of an audio event designed to run on a first 
platform serviced by the audio computer service; and 

a software object having a set of entries, wherein at least one entry is 
associated with the audio event, a first theme and a second theme, the first 

10 theme including a first set of platform dependent audio fields, each platform 
dependent audio field of the first theme associated with at least one audio 
event, the second theme including a second set of platform dependent audio 
fields, each, platform dependent audio field of the second theme associated 
with at least one audio event wherein the first and second themes are arranged 

15 to permit the emulation of audio events of different graphical user interfaces. 

23. A computer-implemented method for servicing audio events 
using a computer service, the computer service including a system manager, a 
widget capable of an audio event corresponding to a first platform serviced by 

20 the computer service, a software object having a first set of platform 

dependent fields and a set of audio events, each audio event associated with at 
least one of the first set of platform dependent fields, the method comprising: 
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requesting a platform dependent field corresponding to the platform 
dependent audio event from the system manager; 

retrieving a platform dependent audio field that may identify a 
platform dependent audio output, wherein the retrieving is performed by the 
5 system manager; and 

accessing the platform dependent audio output identified by the 
platform dependent audio field. 

24. A computer program product for servicing audio events for a 
10 platform independent computer service, the product comprising: 

computer code that includes a first set of platform dependent fields 
which can provide audio output for a first platform; and 

computer code that includes a set of audio events, each audio event 
associated with at least one platform dependent field of the first set of 
15 platform dependent fields, wherein the first set of platform dependent fields 
are included in a first theme which relates the first set of platform dependent 
fields to the first platform. 
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A Generic, Cross-Platform, Cross-L&F, 
Component Level Audio Feedback on the Java 

Platform 



Abstract 



Apparatus, methods and computer program products are disclosed for 
providing audio output in conjunction with a platform independent computer 
service. A software object is described which includes modular themes which 
can be flexibly changed in order to service multiple platforms. Each theme 
includes a set of platform dependent audio fields designed to run on a 
particular platform. Each of the set of platform dependent audio fields is 
associated with at least one of a set of audio events which requires audio 
output. In this manner, a computer service is capable of providing a platform 
dependent audio output by calling the platform dependent audio field 
corresponding to the event. 



SUN1P223/P3750/SDB/WJP 



33 





102 




component 




Ul Manager 


~4 ► 



s 



104 



100 




FIG. 1 
(PRIOR ART) 



S 



component 



listener 



202 



•212 



Ul Manager 



S 204 



200 



Multiplexer Ip206 
(JLF/Metal) 



Primary L&F 



^208 



Audio L&F 
theme 



LT 210 
LT 214 



FIG. 2 



Hash Table (Mcintosh THEME) 



300 



306 



302- 
308- 



Event 


field 


button mouse press 


./audio/mac/button. mouse.press.aif 


button mouse release 


Vaudio/mac/button.mouse,reIease.aif 


internal frame minimize 


./audio/mac/internal.frame.minimize.aif 


internal frame maximize 


./audio/mac/internal.frame.maximize.aif 











Lj-304 
IT 312 



FIG. 3A 



Hash Table (Windows THEME) 



330 



/-604 



Event 


field 


button mouse press 


null 


button mouse release 


null 


internal frame minimize 


./audio/mac/internal.frame.minimize.aif 


internal frame maximize 


./audio/mac/internalframe.maximize.aif 











j-604 
332 
334 



FIG. 3B 



Install ALF 



} 


f 


Ul manager requested to 
install ALF as as auxiliary 
L&F 




r 


Ul manager plugs in 
multiplexer as current 
L&F 




r 


Ul manager informs 
multiplexer that the old 
current L&F is the 
primary L&F 


1 


r 


Ul manager informs 
multiplexer that ALF is an 
auxiliary L&F 




r 


Multiplexer Instructs ALF 
to Initialize 


^ 


f 



S 402 



j-404 



j-406 



S 



408 



j-410 



Done 



FIG 4 



Add listeners to 
Components in UI 
Interface Table 



j-502 



Determine primary L&F 



j-504 



Load appropriate theme ^J"506 
for the primary L&F 



Cache default table 
values from appropriate ^p508 
theme in UI member 
variable 



Done 



FIG 5 



600 



YES 



Ul Event Handling 



1 


f 


Ul is notified of a relevant 
component event 




r 


Get auditory pointer 

associated with 
component state from 
cached Ul member 
variable 


\ 


r 



s 



604 



Is the pointer null? 



•606 





NO 

r 


Play auditory information 




r 



j-608 



< 



Done 



FIG 6 



Ul modifies ALF of lp 
Primary L&F change 



702 



Determine new 
primary L&F 



704 



Load appropriate theme ^p706 
for the primary L&F 



Cache default table 
values from appropriate 
theme in UI member 
variable 



J-708 



Done 



FIG 7 



INPUTS/OUTPUTS 



EXECUTING SOFTWARE/ 
SYSTEMS 



JAVA SOURCE CODE 



public class HelloWorld { 
public static void main (String args){ 
System-out-printlnCHelloWorld"); 

} 

} 




CLASS FILE 



CA FE BA BE 00 03 2D 00 20 08 00 
1DO7 0EO0 16 00 1E07 00 1C09 
98... 00 02 00 18 



905 



903 



BYTECODE 
COMPILER 





907 



JAVA VIRTUAL 
MACHINE 



FIG. 9a 



DECLARATION AND POWER OF ATTORNEY 
FOR ORIGINAL U.S. PATENT APPLICATION 

Attorney's Docket No.P3750/SUNlP223 

As a below-named inventor, I hereby declare that: 

My residence, post office address and citizenship are as stated below next to my name. 

I believe that I am the original, first and sole inventor (if only one name is listed below) or an original, first and joint inventor (if 
plural names are listed below) of the subject matter which is claimed and for which a patent is sought on the invention entitled: 
CROSS-PLATFORM AUDIO FEEDBACK FOR GUI COMPONENTS the specification of which, 

(check one) 1. ^ is attached hereto. 

2. lII was filed on as 

U.S. Application No. 

and was amended on 



3 . Q was filed on as 

International PCT Application No. 

and was amended on . 

'fjhereby state that I have reviewed and understand the contents of the above-identified specification, including the claims, as 
Amended by any amendment referred to above. 



i&cknowledge the duty to disclose information which is material to the examination of this application in accordance with Title 
: 3f, CFR§ 1.56. 

iPnor Foreign Application(s) 

J hereby claim foreign priority benefits under Title 35, United States code, § 119(a)-(d) or § 365(b) of any foreign applications) 
jfqr patent or inventor's certificate, or § 365(a) of any PCT International application which designated at least one country other 
jtHan the United States, listed below and have identified below, by checking the box, any foreign application for patent or 
;irjyentor's certificate, or PCT International application having a filing date before that of the application on which priority is 
6|kimed: 

:; ;;f Priority Benefits Claimed? 

'"M Yes No 



(Application No.) (Country) (Filing Date) 



Yes No 



(Application No.) (Country) (Filing Date) 

Provisional Application(s) 

I hereby claim the benefit under 35 U.S.C. § 1 19(e) of any United States provisional application(s) listed below: 



(Application No.) (Filing Date) 



(Application No.) (Filing Date) 



Atty. Dkt No.: P3750/SUN1P223 

(Revised 3/29/99) 



Page 1 of 2 



~ft»fa&S. Application(s) 

I hereby claim the benefit under Title 35, United States Code, § 120 of any United States application^), or § 365(c) of any PCT 
International application designating the United States, listed below and, insofar as the subject matter of each of the claims of this 
application is not disclosed in the prior United States or PCT International application in the manner provided by the first 
paragraph of Title 35, United States Code, § 1 12, I acknowledge the duty to disclose information which is material to 
patentability as defined in Title 37, Code of Federal Regulations, § 1.56 which became available between the filing date of the 
prior application and the national or PCT international filing date of this application; 



(Application No.) 



(Filing Date) 



(Status - patented, pending, abandoned) 



(Filing Date) 



(Status - patented, pending, abandoned) 



(Application No.) 
Power of Attorney 

And I hereby appoint the law firm of Beyer & Weaver, LLP and all practitioners who are associated with the Customer Number 
022434 as my principal attorneys to prosecute this application and to transact all business in the Patent and Trademark Office 
connected therewith. 



Direct Correspondence To: 



Customer Number: 022434 

BEYER & WEAVER, LLP 
P.O. Box 61059 
Palo Alto, CA 94306 



Ul 

022434 

PATENT TftflOEHfNK OFFICE 



direct Telephone Calls To: 



Steve D Beyer at telephone number (650) 493-2100 



thereby declare that all statements made herein of my own knowledge are true and that all statements made on information and 
belief are believed to be true; and further that these statements were made with the knowledge that willful false statements and the 
iiiie so made are punishable by fine or imprisonment, or both, under section 1001 of Title 18 of the United States Code, and that 
■such willful false statements may jeopardize the validity of the application or any patent issuing thereon. 



^typewritten Full Name of 
iStple or First Inventor: 

Inventor's signature: 

Residence: (City) 
Post Office Address: 



Michael C. Albers 



Citizenship: 



United States 



Date of Signature: (ht*^ g/ y Iff? 



San Francisco 



(State/Country) 



1366-A 12 th Avenue, San Francisco, CA 94122 



CA/US 



Full Name of Second Joint 
Inventor (if any): 

Inventor's signature: 

Residence: (City) 
Post Office Address: 




Citizenship: 



United States 



Foundation Valley 



Date of Signature: Q7^ 1 2j I <\ 

(State/Country) CA/US 



1608 Woodridge Circle, Foundation Valley, CA 94303 



Arty. Dkt. No.: P3750/SUN1P223 

(Revised 3/29/99) 



Page 2 of 2 



PATENT 



IN THE UNITED STATES PATENT AND TRADEMARK OFFICE 



In re application of: Albers 



Attorney Docket No.: SUN1P223/P3750 



Application No.: Please Assign 



Examiner: Not Assigned 



Filed: Herewith 



Group: Not Assigned 



Title: CROSS-PLATFORM AUDIO FEEDBACK 
FOR GUI COMPONENTS 



ASSOCIATE POWER OF ATTORNEY 



Assistant Commissioner for Patents 
Washington, DC 20231 



The undersigned attorney of record in the subject patent application hereby grants an 
Associate Power of Attorney to Kenneth Olsen, Reg. No. 26,493; Timothy J. Crean, Reg. No. 
37,116; Philip J. McKay, Reg. No. 38,966; Robert S. Hauser, Reg. No. 37,847; Joseph T. 
FitzGerald, Reg. No. 33,881; Alexander E. Silverman, Reg. No. 37,940; Christine S. Lam, Reg. 
No. 37,489, Anirma Rakshpal Gupta, Reg. No. 38,275 and Sean Patrick Lewis, Reg. No. 42,798 
all of Sun Microsystems, Inc. to prosecute this application and transact all business in the Patent 
and Trademark Office connected therewith. 



Please send all correspondence for this application as follows: 



r 



liiiiiii 



Customer Number 022434 

BEYER & WEAVER, LLP 
P.O. Box 61059 
Palo Alto, CA 94306 



022434 



PATENT TRADEMARK OFFICE 



Please direct any calls to Joseph M. Villeneuve (510) 843-6200. 



Respectfully submitted, 
BEYER & WEAVER, LLP 




Date: l«M6'*H 



Joseph M. Villeneuve 
Reg. No. 37,460 



Atty.Dkt.No.: SUN1P223/P3750 
[Revised 8/99] 



Page 1 of 1 



